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Abstract 

A shift-invariant system is a collection of functions {g m ,n} of the 
form g mn (k) = g m (k — an). Such systems play an important role 
in time-frequency analysis and digital signal processing. A principal 
problem is to find a dual system 7 mjn (/c) = 7 m (fe — an) such that each 
function / can be written as / = ^2{f,7 m ,n)9m,n- The mathematical 
theory usually addresses this problem in infinite dimensions (typically 
in L 2 (R) or £ 2 (Z )), whereas numerical methods have to operate with 
a finite-dimensional model. Exploiting the link between the frame 
operator and Laurent operators with matrix-valued symbol, we apply 
the finite section method to show that the dual functions obtained by 
solving a finite-dimensional problem converge to the dual functions 
of the original infinite-dimensional problem in £ 2 (Z). For compactly 
supported g m ,n (FIR filter banks) we prove an exponential rate of 
convergence and derive explicit expressions for the involved constants. 
Further we investigate under which conditions one can replace the 
discrete model of the finite section method by the periodic discrete 
model, which is used in many numerical procedures. Again we provide 
explicit estimates for the speed of convergence. Some remarks on tight 
frames complete the paper. 
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1 Introduction 



Shift-invariant systems play an important role in time-frequency analysis 
and digital signal processing. In this paper we consider time-discrete shift- 
invariant systems, by which we mean functions g m ^ n of the form 

9m,n{k) = g m (k-na), k,n E Z,m = 0, 1, . . . , M - 1 (1) 

where g m E £ 2 (Z) and < a E N. In the engineering literature such a system 
is known as filter bank. 

Since the g m , n are in general not orthogonal, we are interested in finding 
dual systems 

lm,n{k) = lm{k - na), k, n E Z, m = 0, 1, . . . , M - 1 (2) 
such that any / E ^ 2 (Z) has a ^ 2 (Z)-convergent representation 

/ ^ ,(fi 1m,n) 9m,n ■ (3) 
m,n 

There is a variety of research papers dealing with shift-invariant systems 
in L 2 (R) or £ 2 (Z), there is also no lack of methods claiming to efficiently solve 
for the duals, those method naturally operate in finite dimensions. But only 
little is known about the relation of the finite-dimensional solutions and the 
original solutions of the infinite dimensional model. For practical purposes 
it is not enough to ensure that an approximation converges to the original 
solution, but one also should try to provide a priori bounds on the rate of 
convergence. The goal of this paper is to clarify the relation between the 
approximate dual functions computed by a finite-dimensional approach and 
the original dual functions in £ 2 (Z). 

Throughout the paper we will use two key ideas to derive our results. 
We exploit the link between frame operators of shift- invariant systems and 
Laurent operators with matrix valued symbol to apply the finite section 
method for the proof of convergence. Furthermore we will discuss the rate 
of convergence making use of results of the off-diagonal entries of the inverse 
of certain types of matrices. 

A detailed investigation of shift-invariant systems in i 2 (M) can be found 
in the papers of Ron and Shen [^, 2£|. In |2l| Janssen analyses duality 



conditions for shift-invariant systems in L (R) and £ (Z) with emphasis on 
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Gabor systems. For an overview of the theory of filter banks the reader may 



consult 31 



The concept of frames |], Q provides a natural environment to study 



shift-invariant systems || |27|, |23|. We say that the set {g m ,n} is a frame for 
£ 2 (7j) if there exist constants A, B > such that 

A\\f\\ 2 < J2\(f'9m,n)\ 2 < B\\f\\ 2 , V/ e £ 2 (Z) . (4) 

m,n 

If the shift-invariant system {g m ,n\ satisfies condition (£I[) we will also call it 
shift-invariant frame. The dual frame is given by 

lm,n{ k ) = {S~ l 9m){k - no) (5) 

where S is the frame operator defined by 

Sf = ^2(f,g m ,n)g m ,n- (6) 

m,n 

Among all dual systems satisfying (|3]) the duals defined by (|5|) have min- 
imal € 2 -norm. In this paper we restrict our attention to duals with minimal 
I -norm, therefore we will be somewhat sloppy in our terminology and refer 
to the 7 min defined in (|5|) as the duals. 

We define the analysis operator F by 

F:fe l 2 (Z) -+Ff= {(f,g m ,n)}m,n (7) 

and the synthesis operator, which is just the adjoint operator of F, by 

F* :cE£ 2 (Zxl)^F*c = J2 Cm, n g m ,n (8) 

m,n 

where I := {0, 1, . . . , M—l}. The frame operator can be written as S = F*F. 
If the g m are constructed from a single function g by modulations, i.e., 

g m (k) = e 2mmk ' M g{k) (9) 



we obtain the well-known Gabor system or Weyl-Heisenberg system [T3|, ITT] . 
A nice property of Gabor frames is that the dual frame is also generated by 
a single function, we have || 

7m,n(fc) = e 2wimk/M ~f{k - no) with 7 = S~ x g . 
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In the filter bank community systems of the form (0) are known as (oversam- 
pled) DFT filter banks 0. 

For some special choices of {g m ,n} closed-form solutions for the duals 
are known || [12], [24] (which does not necessarily mean that those closed- 
form solutions can be cheaply computed in practice). In general however the 
numerical computation of the dual frame elements 7 m involves the solution 
of the system of equations @ of biinfinite order, independently of the choice 
of the basis for the matrix representation of S (be it the standard basis in 
£ 2 (Z) or the so-called polyphase representation used in the theory of filter 
banks). We certainly cannot solve a system of biinfinite order, but we can 
solve it approximately, based on a finite-dimensional model. 

Whatever finite-dimensional model we choose to compute approximate 
duals, we have to ask if these approximations really converge to the original 
solution with increasing dimension and, whenever possible, we have to give 
a priori bounds on the rate of convergence. These are the problems we are 
going to attack in this paper. 

Before we proceed we introduce some notation. Let x G -£ 2 (Z), then ||x|| is 
the standard £ 2 -norm of x. We define the spectrum of an operator T as usual 
by cr(T) = {/i £ C : det(T — jil) = 0}. If T is positive definite and invertible 
then ||T|| = max{/i : jj, G cr(T)} and in this case cond(T) := ||T||||T _1 || 
denotes the condition number of T. 

2 Dual frames and the finite section method 

Due to the shift-invariance property (g) of the ^ m ,ri we only have to compute 
approximations to the duals 7 m = 7 mi o for m = 0, . . . , M — 1, since all other 
■y mtn are just translations of j m . Equations (j^j and (Q) tell us that all shifted 
copies g my n are required for the computation of the duals 7 m . But if the 
g m have nice decay properties, such that most of their energy is contained in 
some interval around the origin, say, then one may hope that the 7 m will have 
the same properties. One could further argue that using only those functions 
g m n "living" in some interval around the origin, [-N, N] say, should be 
sufficient to compute a good approximation to j m . 

Let us put these vague ideas in a more precise mathematical setting. For 
N G N define the orthogonal projections Pn by 

P N x = (..., 0, 0, X- N , X- N+1 , x N -i, x N , 0, 0, ... ) (10) 
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and identify the image of P/v with the 2N + 1-dimensional space C +1 . We 
construct a finite-dimensional approximation Sn of the frame operator S via 
the truncated frame elements P/vSVn.n by 

Sn = (PnF*)(FP n ) (11) 

where F is defined in ([?]). The iV-th approximation 7^ to 7 m is then given 
by the solution of the finite-dimensional system of equations Sn^tu^ = P/v^m- 
In other words we truncate all frame elements g m ,n to the interval [-N, N]. 
The questions that arise with such an approximation scheme are: 

(i) Does 7™ converge to 7 m for N — > 00? 

(ii) If the g m satisfy certain decay conditions, can we give an estimate on the 
rate of convergence? In other words: given 5 > 0, can we provide an a priori 
estimate for the size of the interval [— N, N], such that ||7 m — 7m || < 5, 
where N depends on 5 and the decay of g m 7 

In numerical procedures people often use a periodic finite-dimensional 
model in order to approximate j m . Instead of the truncated functions P/v(? m 
(which could be thought of as padded with zeros beyond the interval [-N, N]), 
the P/v^m are extended periodically across the interval [— N, N]. In other 
words all computations are done in the ring Z 2 /y+i = Z mod (2N +1). In 
Section || we will investigate the behavior of the periodic approximate dual 
functions, when the length of the period approaches infinity. 



2.1 The finite section method and Laurent operators 

The finite section method or projection method is a classical technique to 
approximate the solution of infinite Toeplitz-type systems. For an introduc- 
tion and many variations of the theme the reader is referred to the books of 



Gohberg and Fel'dman Bottcher and Silbermann [H] and Hagen, Roch, 
and Silbermann | 18[| . Since we use the finite section method as a main tool 
throughout the paper, we briefly describe it in the specific context we will 
apply it. 

Let T be the complex unit circle and let t(z) be a continuous function on 
T, t G C(T). Let Tk G C stand for the fc-th Fourier coefficient of r, 



Tk = I T (^ Mu )e- Mku duo 
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then the operator T(r) which acts on functions x £ € 2 (Z) by 



(Tx) k = 



i~k—j%j j 



0,1, 



(12) 



is called Laurent operator with generating function or symbol r. A Laurent 
operator may also be characterized as a bounded linear operator acting on 
£ 2 (Zi) which commutes with the forward shift operator on -£ 2 (Z), cf. Chap- 
ter 13.2 in [13 1. Since a Laurent operator can be represented by a biinfinite 
Toeplitz matrix, we will often identify T{r) with its matrix representation. 

Consider the operator equation Tx 
sent at ion 



y,x } y G £ (Z) or, in matrix repre- 



to n T 2 

T-2 T-l TO 





X-i 




y-i 




Xq 




yo 




Xi 




yi 



(13) 



For the approximate solution of the biinfinite Toeplitz system in (13) by 
the finite section method one considers the finite linear equations 



T NX W = yW 



(14) 



where y 



(TV) 



(y 



(AT) 
N ' 



and where Tm are the finite sections of the 



biinfinite Toeplitz matrix in flT3"|): 



T = (t ) , T x 



r r 2 r 2 
T-l Tx Tx 
T-2 T_i T 



To 



tq n t 2 r 3 r 4 

T-l T T l T 2 r 3 

T-2 T-l Tq Tx T 2 

T-3 T -2 r -l r T l 

r_ 4 r_ 3 T_ 2 T-l r 



Using the the orthogonal projections defined in (|I~0"D and identifying the 
image of with the 2N + 1-dimensional space C N+1 we can express the 
equations ( |T3"D in the form 



P N TP N xW =P N y. 



(15) 
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We say that the finite section method is applicable to T, if beginning with 
some N EN for each y G £ 2 (Z) the equation 

P N TP N xW = p N y (16) 

has a unique solution x^ G ImP/v and as N — > oo the vectors tend to 
the solution of Ta; = y. 

Now let r be a continuous ax a- matrix valued function on T, r G C axa (T). 
Let Tfc G C axa stand for the k-th Fourier coefficient of r, then the operator 
T defined by the action 

(Tx) k = ^ T k-jXj , X El 2 a (17) 

is called a block Laurent operator with generating function r. A block Laurent 
operator can be represented by a biinfinite block Toeplitz matrix, where the 
Tfc in (^) are a x a matrices. Analogous to above, for the approximate 
solution of biinfinite block Toeplitz systems we consider finite sections of the 
form 

P N TP N x {N) =P N y. (18) 

It is a well known fact and a direct consequence of the definition of shift- 
invariant systems, that the associated frame operator S is a block Laurent 
operator, since S commutes with the shift operator U a ((j>k)k& '■= {. < t>k-a)k&- 
Hence the operator equation Sj m = g m can be expressed as a biinfinite 
block Toeplitz system of equations, where the blocks of the system matrix 
are of size a x a. The blocks themselves are not Toeplitz. It is exactly this 
block-Laurent structure of S that is utilized in the polyphase representation 
proposed in the filter bank theory |JT . 



Let Sn be the frame operator associated with the truncated frame ele- 
ments Pjvfl'm.n as defined in flnp. Since Sjy = P^F*FP N = P n SPn, the 
corresponding system of equations SnJ^ = gin^ is just a finite section of 
the biinfinite system S7 = g Hence it is natural to ask if we can compute 
approximate the duals 7 m by solving 

P N SP Nl W = P N g (19) 

for increasing N, or in other words, we want to know if the finite section 
method is applicable to S. Moreover we are also interested in the rate of 
convergence, in case the finite section method applies to S. 
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3 Rate of convergence using the finite section 
method 

If the functions g m have a certain rate of decay, one would expect that the 
dual functions also share this behavior. We consider the following three types 
of decay for g m and study first how a certain decay property translates to 
decay properties of the frame operator S. 

a) Exponential decay: \g m {k)\ < cA Q ' fc ' for < a < 1, A G (0, 1) and some 
constant c. 

b) Polynomial decay: \g m {k)\ < c(l + for a > 1 and a constant c. 

c) Compact support: g m {k) = for \k\ > s. 

The following proposition is a simple modification of well-known results 
used in connection with the construction of splines and wavelet bases. 

Proposition 3.1 Assume that the functions g m .n, m — 0, . . . , M — 1 consti- 
tute a shift-invariant frame for £ 2 (Z) with frame operator S and duals 

(a) Exponential decay: If \g m (k)\ < CxA ai ' fe ' for < a.\ < a < 1 and 
A G (0, 1). Then there exists an ct<i < a and a constant 02(0^2) such that 

\S k ,i\ < c 2 (a 2 )X a2lk - 11 for0<a 2 <a. (20) 

Further it holds for the duals 7 m 

\j m (k)\ < c 3 (a 3 )A a3|fc| . (21) 

for some 0J3 < a and a constant 03(0*3). 

(b) Polynomial decay: If \g m (k)\ < c(l + |A:|)~ a for a > 1, then there exists 
a constant C\ such that 

\S K i\ < Cl (l + |A;-/|)- a . (22) 

Further there is a constant c 2 such that 

\lm(k)\ <c 2 (l + \k\)- a . (23) 

Proof: The exponential decay (p0|) and the polynomial decay (|22|) re- 
spectively, follow from Proposition 1 in |20| by Jaffard. Proposition 2 and 
Proposition 3 in imply formulas (|2l|) and (Uoj). □ 
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We admit that ( PH ) and (^) are not very satisfactory from a practical 
point of view, since both estimates do not provide explicit expressions for 
the involved constants. We hope to address this problem in our future work. 

Fortunately for compactly supported g m we can do better. Compact 
support of the g m allows us to compute the transform coefficients (f,g m ,n) 
exactly and also the matrix entries of S can be calculated by finite sums. 
In filter bank design the analysis filters are often designed to be compactly 
supported (FIR filter banks). Note however that compact support of the g m 
does not imply compact support of the duals. For Gabor frames Bolcskei 
has shown |T[ that the minimal norm duals are only compactly supported in 
very specific cases. It is well known that the redundancy of frames provides 
some design freedom for the dual systems, which for instance can be used 
to construct dual functions with compact support [|32], [5], []J. The following 
results allow us to obtain a good estimate for the decay of the duals 7 mjn for 
compactly supported g m ,n- But before we can state the results we need some 
preparation. 

Recall the a matrix T is called m-banded, if Tj^ = for \k — l\ > s. The 
following theorem about the decay of the inverse of a band matrix is due to 
Demko, Moss, and Smith ||. 

Theorem 3.2 LetT be a positive definite, m-banded, bounded and boundedly 
invertible matrix in £ (I), where I = Z, Z + or {0, 1, . . . , N—l}. Let B = \\T\\ 
and A = ||T _1 || and set k = B/A, q = and X = q™. Then we have 

\T k l\ < DX^ (24) 



where 



I>=1=«{1,£±^> (25) 



Further we shall need following corollary 

Corollary 3.3 Let T be a matrix whose entries decay exponentially off the 
diagonal, i.e., 

IT^I < cA |fc ~ z| k,leZ (26) 



and let y be a sequence in £ 2 (Z) with \\y\\ = 1 and with compact support such 
that yk = for \k\ > s. Denote <fi = Ty, then it holds 

W<^Al fc l. (27) 
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Proof: We have 

oo s 



l=-s 



For reasons of symmetry we can restrict ourselves to the case (f>k with k > 0. 
First we consider the case k > s: 



i0 fc i < J2 cXlk ~ 11 = cXh J2 x °~ j = cXk — 

l=-s 

Now we consider the case < k < s: 



k-1 s 

k 



\<i ) k\<J2 cXlk ' ll = J2 cXk ~ l +T, cXl 

l=—s l=—s l=k 

k+s— 1 s—k 

= c \ k+s x ~ j + cJ2 x ' 

3=0 3=0 
1 _ \ k + l 1 _ \s-fc+l 

X k +S+1 _ X k +S f 1 _ A 

\-fe+l \s+l \-fc \s-2fc+l 

= cA fe - ^— + cA fc A ~\ 

1 - A 1 - A 

— cA 

1 - A 

Now we show that for < k < s it holds 

k \~ k+1 - \ s+1 + X k - A s - 2fc+1 k \- s - \ s+1 

cA cA 

1 - A ~ 1 - A 

Set h(x) = \- x + A x+1 - A - 1 for x = 0, 1, . . . and note that 

^-(z+i) ^ a :e+1 
A _(a:+1) (l - A) > A x+1 (l-A) 
\- {x+1) - \- x > \ x+1 - \ x+2 
<£> \ x+2 + \- {x+1) - A - 1 > A^ 1 + \~ x - A - 1 
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whence h(x) is strictly monotonically increasing. Since h(0) = and by 
setting x = s — k it readily follows that 

y+l _ yk+l + X s-2k+l _ X -k < X s+1 _ ^-s 

which implies ([!]) and hence 

|0fc| < cA |fe| -^- keZ. (28) 

1 — A 

□ 

Now it is easy to estimate the decay of the dual functions ^ m ,n for com- 
pactly supported g m . 

Proposition 3.4 Let {g m } be a shift-invariant frame for t 2 (Z) with \\g m \\ = 
1 and assume that g(k) = for \k\ > s. Let A,B be the frame bounds and 
set k = B/A and q = Then it holds 

\lUk)\<C\W^-. (29) 
where X = q^ and C = -4 max{l, (1+ 2 ^ > }■ 

Proof: Observe that S is a 2s-banded matrix. Now the result is an imme- 



diate consequence of Theorem [T2] and Corollary |3T3| . 
□ 

We are now able to answer the question about the approximation of dual 
shift-invariant frames by duals computed via the finite section method. 



Theorem 3.5 Assume that {g m ,n} is a shift-invariant frame for t (Z) with 
||g m || = 1 and frame bounds A,B. Set Sn = P^SPn and jm = S^P^gm 
for m — 0, 1, . . . , M — 1 and denote k = B/A. Then it holds: 

(i) The finite section method is applicable to S and 7™ converges to 7 m for 
N -> 00. 

(ii) If the g m are compactly supported with g m (k) = for \ k\ > s and N > 2s, 
then the rate of convergence can be estimated by 

\\lm ~ 7S°II < V2CX N (X S - A s+1 )- 3 (30) 
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where q = , A = <p s and 

C = ^-max{2/€,(l + v^) 2 }. (31) 

(Hi) If \g m (k)\ < ciA Ql ' fc ' for < a% < a < 1 and A G (0, 1), then there exists 
an a>2 < a and a constant 02(02) such that 

llTm-7^11 <Kc 2 {a 2 )X^ N . (32) 

(iv) If \g m (k)\ < c(l + |A;|) _a for a > 1, then there exists a constant c\ such 
that 

llTm-T^II <«ci(l + |Aq)- a . (33) 

Proof: (i) Recall that S is a block Laurent operator. It follows from Theo- 
rem 9.3 in [|l(J by Gohberg and Fel'dman or alternatively from Theorem 4.1 
15f by Gohberg and Kaashoek that S^ 1 converges to S^ 1 strongly, i.e., 
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\\S N x - Sx\\ -»• ViG £ 2 (Z), for N -> 00 

if the generating function of S is continuous on the unit circle T and if the 
operators QSQ and QS*Q are invertible on ^ 2 (Z + ), where the projection Q 
is defined by 

Qx = (. . . ,0,x ,xi, . . . ) . 

The invertibility of QSQ is a direct consequence of the positive-definiteness 
of S, since for x G ImQ, ||x|| = 1, we have (QSQx,x) = (Sx,x) > 0, hence 
QSQ is invertible. In fact using the same argument we conclude that SV is 
invertible for all AT = 0, 1, 2, ... . 

The continuity of the generating function of S follows from the fact that S 
is banded, thus the generating function is a trigonometric matrix polynomial 
and therefore continuous on the unit circle T. Hence the projection method 
is applicable to S for any right hand side G € 2 (Z) and the first part of the 
theorem is proved. 

In order to estimate the rate of convergence for (ii), (iii) and (iv) consider 

llTm — lm II = l|5 1 9m — 5 JV 1 P/v5' m || = \\S 1 g m — S 1 SS N 1 Pjsrg m \\ 

— I|5 1 || (\\g m — SNS N l PNg m \\ + WSNS^PNg-m — SS N l PNg m \\) 
< l|5 _1 || (hm - PN9m\\ + || (5V - S)S N 1 P N g m \\) 
<A- 1 \\(S N -S)S N 1 P N g m \\ (34) 
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(ii) Recall that S is a 2s-banded matrix, i.e., Sk,i = for \k — l\ > 2s. 
Applying Theorem |3.2| we can estimate the decay of the entries of S~ x by 

\3^\<DX^ (35) 

where D and A are as in Theorem |3.2| with m = 2s. Let //q , • • • ; f^N-i ^ e the 
eigenvalues of Sjy. Since Sn is Hermitian positive definite, it follows from 
Cauchy's Interlace Theorem [IS] that the eigenvalues ^ N 1 \...,fiff_ 1 L) of 
Sjv-i satisfy 

^ < < a* < ■ ■ ■ < < & , 

which implies 

cond(SV) < cond(S') . 

Hence we can use the same A and the same constant D in order to bound 
the decay of the entries of S^ 1 independently of N and obtain 

\(SAA<DX^. (36) 
Set 4>m ^ = S^PjsfQm then it follows from Lemma [37| that 

<tfAi*'^, keZ. (37) 

In the next step we estimate \\(Sn — S)S N 1 PNg m \\. Write = (Sn — S)4>^ 
and observe that ||e£?^|| 2 = YT=-oo l( e ™ )k\ 2 = 2 Y^Lo K e ™ )*i 2 ( note that 
(e^)o = 0). For k = 0,1., . . . consider 

oo k+2s 
l=—oo l=k—2s 

Clearly (eif )i = for /c < iV, hence we only have to consider the case 
k > N: 

k ~\~ 2 s 7—1 \ ^ k ~\~ 2 s 

l(e£°)fcl = I E (^-sMC^s^ E A '" 

l=k-2s l=k-2s 

BD\~ S X k ~ 2s - X k+2s BD k _ 3s 
- T^A l^A " (1-A) 2 ' 
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whence 

2 



fJN)\ |2 / ( BD \ X 2k-6s 



Due to (Sjv — S')^,; = for \k — 1\ > 2s and since ((fim )k — for \k\ > N we 
obtain $^£L |(e^)fc| 2 = Y^k=N+i \i e m )k\ 2 and therefore 



W+2s 2 2 N+2s 



\e^\\ 2 = 2 J2 \(e^) k \ 2 <2^--X^ £ A 2 * 

fc=JV+l ^ ' k=N+l 

OR2n2 \2-6s \2-2s / \~3s \ 2 

^ Lt> U ^ 2N A -A < / ^ Dna A v 



:i-Ar i-v -(^ Bm ' (1 _A)= 

which implies 

||eW || < y/2BDX N (X 8 - A s+1 )- 3 (38) 

Combining (|38D with fl34l) yields the bound (|30|) . 

The statements in (iii) and (iv) follow by applying Proposition |3.1| to fl34| ) . 

□ 

Remarks: 

(i) In spite of these results, good a priori estimates of the frame bounds 
as given e.g. in || 22|] play an important role. 

(ii) A different approach to approximate the inverse of the frame operator 
by finite dimensional methods is due to Casazza and Christensen. In Q 
they consider a more general setting, however at the cost that their 
estimates are less explicit and therefore less useful in applications. 



4 Approximation of tight frames 

An important special case of frames are so-called tight frames, which are de- 
fined in terms of equality of the upper and lower frame bound, i.e., A = B. 
Besides the nice stability property cond(S) = 1, tight frames are distin- 
guished by a simple expression for the duals, which are just scaled versions 
of the original frame elements, more precisely one has 7 m>n = \g m ,n- Due to 
this close relationship to orthogonal bases the construction of tight frames is 
of great interest in theory and in applications. Daubechies || has shown that 
for a given frame, say {4>k} the set of functions {S~2ip k } constitutes a tight 
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frame. Recall that S is positive definite, hence and are uniquely 
determined. 

Recall that S 3 commutes with the same operators that commute with 
5*. For shift-invariant systems this implies that the tight frame generated 
by (fim,n = S~2g mn also constitutes a shift-invariant system. We want to 
approximate the elements of the tight frame {4> m ,n} by the solutions of the 
finite sections 

(PnSPnYh^ = P N g m . 

One can easily check that the entries of and decay exponentially 



off the diagonal, see e.g. |2T], Pq| . The applicability of the finite section 



method follows now from Theorem 5.1 in |Tj|. Along the same lines of the 



proof of Theorem [T5] one can show that <f>m^ '■— (PnSPn)~^ PN9m converges 
exponentially fast to <p m . Since we do not have explicit expressions for the 
decay of the entries of and S~2 we only can give following qualitative 
result for the approximation error. 

Theorem 4.1 Let {g m ,n} be a shift- invariant frame for £ 2 (Z) with frame op- 
erator S and frame bounds A,B. Assume that \\g\\ = 1 and set (fi m = S~2g m 
and (pm^ 1 = (P n SPn)~^ Pn9- Then the finite section method is applicable to 
S*. If moreover g is compactly supported with g(k) = for \k\ > s then 



-4>W\\<KP N N = 0,1, 



for (3 C (0, 1) and some constant K > 0, where (3 and K depend on the frame 
bounds A,B and the support length s, but are independent of N. 



5 Rate of convergence by "canonical" approx- 
imation using a periodic model 

We have seen in Section |] that the functions 7^ which are the duals to 
the truncated functions PNg m ,n converge exponentially fast to the duals 7 m) „ 
of the infinite-dimensional problem. So from a theoretical point of view we 
know that we can compute a good approximation to 7 m by solving the finite 
system Sn^™^ = gm^ ■ From a numerical point of view, however, we are 
interested in solving Sjv7m^ = 9™' as efficient as possible. 

Unfortunately due to the truncation of 5* we loose some structural prop- 
erties of the problem. For instance the inverse of S or the product S 2 still 
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have block Toeplitz structure, whereas S^ 1 and Sff are no longer of Toeplitz 
type. Certainly one could apply one of the fast solvers for Toeplitz systems, 
but we can also try to find a more canonical way to design a finite dimen- 
sional model, which allows to preserve the perfect symbol calculus of Laurent 
operators. This is one motivation to use a periodic model for the design of 
numerical algorithms. 

Despite the fact that the periodic model is widely used in connection with 
shift-invariant systems, almost no attempt has been made to investigate the 
relation between the duals of the periodic finite model and the duals of the 
infinite dimensional problem. 

One exception is |22| where Janssen shows that if the g m ^ n constitute a 
Gabor frame for £ 2 (Z) with frame bounds A, B and if g m>n G i then the 
periodized functions g^ n (k) = YlJL-oo 9m,n(k — jL) constitute a frame for 
C L with frame bounds A, B. Furthermore the duals for the periodized frame 
can be obtained by periodizing the duals of the original frame elements. The 
drawback of this otherwise very appealing result is that the length of the 
period L has to be the least common multiple of the time shift parameter a 
and the number of frequency channels M. This condition can be a serious 
restriction in practice. For instance take a = 2, M = 3, then the periodized 
functions are of length 6, which may be much too short for many applications. 

In this section we will clarify the question under which conditions the 
duals computed within the periodic model converge to the duals 7 mjn when 
the length of the period tends to infinity. 

Let the functions g m be compactly supported, such that g m (k) = for 
\k\ > s. We construct our periodic model, as usual, by extending the trun- 
cated functions P/v(7 m periodically beyond the interval [-N, N] for N > s by 
setting 

p g m (k + IN) := g m (k) for k = -N, ...,N, , / e Z . (39) 

The other elements of our periodic finite shift-invariant system are now given 
by 

P 9m,n{k) = P g m (k- no) (40) 

where the shift, according to our model, is understood as circulant shift. The 
periodicity of the F g m ,n implies that the corresponding frame operator is a 
block circulant matrix, rather than merely a block Toeplitz matrix. Observe 
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that the entries of Sjf deviate from the entries of Sn only in the lower right 
and upper left corner of the matrix. 

In other words we have replaced the block Toeplitz matrix Sn in the 
system SnItu^ = gln^ by a block circulant matrix. However replacing a block 
Toeplitz system by a block circulant matrix in a linear system of equations 
will in general significantly affect the solution. 

Moreover it is a priori not clear under which conditions invertibility of Sn 
implies invertibility of p Sn- For instance take following Hermitian positive 
definite Toeplitz matrix T and its "circulant completion" P T: 



T 



2 


-1 








-1 


2 


-1 








-1 


2 


-1 








-1 


2 



2-10-1 
-12-10 

0-12-1 
-10-12 



then T is invertible, whereas P T is obviously not invertible. 

The following theorem justifies the usage of the circulant model for the 
approximation of dual shift-invariant systems. Implicitly the theorem also 
provides an estimate of the error we make when we approximate the solution 
of a block Toeplitz system by solving the related block circulant system. 

Theorem 5.1 Let {g m ,n} be a shift-invariant frame for ^ 2 (Z) with frame 
bounds A, B. Assume that ||g m || = 1 and that the g m are compactly supported 
with g m {k) = for \k\ > s. Let N > 2s and let p g m ^ n be the periodized 
functions as defined in ( |39"D and (|40|) with frame operator p Sn ■ Then p Sn is 
invertible and ^fm = p S N lp g m converges to 7 m for N — > oo. If N > 3s then 
the rate of convergence can be estimated by 



\PNl m - P l^\ 



< 3V2CX N (\ S - A'' 



where k = 4 , g 



q2s 
1 



and 



C = -max{2fi:,(l + ^) 2 } 



(41) 



(42) 



Proof: First we show that invertibility of S implies invertibility of p Sn- 
The results about the spectrum of block circulant matrices in the proof of 
Theorem 3 in [34| in combination with Corollary 1 in |34] imply that 

Qa(S). 



a 



: p s N ) 
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ct(S) is bounded away from zero since A > 0, hence it follows that p Sn is 
invertible. 



To prove ([IT]) we write 

\\P N jm - P i^\\ <\\im- t2°II + l|JVy£° - <V2°|| ■ (43) 

We already have estimated ||7 m — 7^|| in fl50p of Theorem ^5] , so it remains 
to estimate ||.P/v7m^ — ^m^H- Proceeding analogously to the calculation 
preceding equation fl34]) we can write 



||7#° - P 7^ll < A- 1 !!^ - S N ) p £tfP N g m \\ • (44) 

Note that p Sn is three-band matrix, with one band centered at the main 
diagonal, and two other bands of width 2s located at the lower left and 
upper right corner of the matrix. It follows from Proposition 5.1 in || that 
the entries of p 5'^ 1 decay exponentially off the diagonal and off the lower 
right and upper left corner. More precisely 

uPa-u |</^ IM ifO<|fc-/|<iV 

K ^ Jwl ^ < £)AJW+1 _ |M i f N + 1< \ k _ ll<2 N 1 } 



where D and A are as in Theorem |3.2| with m = 2s. 

Before we show that (pm^ '■= P S N lp g m also decays exponentially, observe 
that due to the construction of p Sn the matrix E N := p Sn — is a sparse 
matrix having non-zero entries only in the upper right and the lower left 
corner, as illustrated in 



E 



N 



X 



X 



X 



N-2s + 1 

X 







x" 



(46) 



Denoting e m = E N p S N lp g m , it readily follows from the sparsity of E N that 
only the first 2s and the last 2s components of are non-zero, hence only 
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the decay of the first 2s and last 2s components of 4>ffl = p S^ lp g m is of 
interest . 

Since p Sn is a three-band matrix, the decay behavior of the entries of 
p Sn is a little bit more complicated than for ordinary band matrices. We 
split the analysis of the decay of the entries of 4>m^ into two steps by consid- 
ering first the entries ((f$P)k for k = N — 2s, . . . , N — m — 1 and then those 
for k = N - m, . . . , N - 1. 
Case k = N - 2s + 1, . . . , N - s: 

N s 
l=-N l=-s 

due to the compact support of g m . Hence 

l(^)*l<lEW) w |<i?X;Al*-'l. (47) 

l=— s l=—s 

The assumption N > 3s implies that k > I hence 

D Y = DY \ k - 1 = D\ k X ~ S ~ X ° +1 < -?-\ k - s (48) 
^ ^ 1 - A - 1 - A K ' 

(=— s l=—s 

Case k — N — m, . . . ,N — 1: 



s k-N-1 s 

1(4^1 <iE( p ^)mI< E \( Ps ~nU+ E \( Ps nU 

l=-s l=-s l=k-N 

k-N-1 s 

< d e \ 2N+i - k+i + d e 

l=-s l=k-N 

k-N+s-1 n ,_ s \ -(fc-AT— 1) 



A 1-A 



1-A 

< -^(A fc - S + A 2JV+1 - fe - s ) < -^\ k - s (49) 
1 — A 1 — A 
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Note that He^H 2 = ^ = _ N \(e^) k \ 2 = 2 £f =7V _ 2s+1 K^k] 2 . Due to the 
special sparsity structure of En as illustrated in (|46|) we can write 

N 9Rn N 

1(4^1 < E \(E N ) k M\<f^J*- S E A ' 

i=2AT-2s+l+fc ' l=2N-2s+l+k 

2BD _ g 2N-2s+l+k \AT \ ^\ ^ 2BD ,k-3s+2N 



It follows 



and 



2BD x 2 



3 (JV)\ 1 2 ^ / <^±j±j \ 2/C+47V-6S 



-jv+28-1 (inD\i - N + 2s - 1 

(A0||2_Q \( P W\,\ 2 < oS-f—L- x 2fc - 6s + 4Ar 



E K^'HI 2 s 2 7f^4 E * 2 

fe=-JV ^ ' fc=-AT 



(2Bg) 2 A^--A^- / ^ BP V 



and therefore 



| e CJ0 1| < 2v /2 EDA ' 3 V = 2y/2BD(\° - A S+1 )- 3 A W 
(1 - A) 3 



which together with ( f44|) yields the desired estimate (|41|). □ 
The corresponding variant of Theorem f4.1| for the approximation of a 



tight frame via the periodic model is left to the reader. 

In fact, the periodic extension of finite signals is more than just a simple 
and convenient way to hanlde boundary problems. It is in some sense the 
"canonical" way to set up a discrete model, when translations come into play, 
since it allows to preserve important mathematical properties of the infinite 
dimensional problem. 

More generally speaking one preserves the underlying group structure of 
the original problem. By doing so, we can immediately apply the abstract 
results derived for shift-invariant systems [TU, [T7|, |50| . In fact, sometimes, 



e.g. in the case of Gabor analysis |29|]) we gain even more structural prop 



erties compared to the infinite dimensional problem, due to the finiteness of 
the underlying abelian group. 
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